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AUTOMATED IMAGE SIZING AND CROPPING 
Cross-Reference to Related Applications 

[0001] This is a continuation-in-part of patent application Ser. No. 10/617,903 filed on 
July 1 1, 2003 and entitled System and Method for Automated Product Design. 

Field of the Invention 

[0002] The present invention relates to computer-implemented automated product design. 

Background of the Invention 

[0003] Many individuals, businesses and organizations occasionally have a need for 
custom printed materials, such as a birth announcement, a party invitation, a brochure 
describing a product or service, a promotional postcard notification about an upcoming sale, 
or any number of other things. Simply placing plain text on a plain background is usually not 
satisfactory. Most people prefer that their information be presented in a pleasing layout 
combined with one or more attractive images that have some thematic relevance to the 
purpose of the document. Few individuals, however, have the time, desire and expertise to 
experiment with possible layout/image arrangements or to search for, upload, resize, and 
position desirable images. Typically, only larger enterprises with regular and substantial 
printing requirements are able to employ a specialist with graphic design skills. 

[0004] One option for individuals and smaller businesses desiring well-designed, 
professional appearing documents with attractive layouts and images has been the local print 
shop, where they describe their requirements and look through representative samples. 
Multiple visits may be required to review proofs, make corrections or pick up the final 
printed product. As an alternative, various specialized software products are available that 
present a customer with a set of pre-designed document templates in which the user can insert 
the user's personal information to allow the user to prepare personalized greeting cards, 
invitations or the like. These software products must typically be purchased and installed 
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permanently on the user's computer and require at least some familiarization and training to 
be used properly and efficiently. Further, the printing devices connected to the typical 
personal computer used by an individual or small business are often not suitable for, or 
capable of, producing quantities of quality full color materials. 

[0005] To provide an alternative to the above approaches, printing service providers, 
taking advantage of the capabilities of the Web and modern Web browsers, provide document 
design services for user's desiring to create customized documents from any computer with 
Web access at whatever time and place is convenient to the user. These service providers 
typically provide their customers with the ability to access the service provider's web site, 
view product templates and enter information to create a customized markup language 
document. After the document has been designed by the user, Web-based service providers 
also typically allow the user to place an order for the production and delivery to the user's 
home or business of quantities of high quality, printed documents of the type that the user is 
not capable of producing with the printer systems typically connected to most personal 
computer systems. 

[0006] One network-based product design system is disclosed in co-pending and co- 
owned U.S. application No. 09/557,571 entitled "Managing Print Jobs", which is hereby 
incorporated by reference. The system discloses a downloadable editing tool that allows a 
customer to create and edit WYSIWYG ("what you see is what you get") markup language 
documents in the customer's browser. The system makes a number of pre-designed product 
templates available for customer viewing, downloading, and customizing. The customer can 
upload the electronic document to a server and place an order for production of the printed 
products. 

[0007] Pre-designed document templates that can be individually selected and 
downloaded to assist the user in creating a document in the user's browser are known in the 
art. Typically, a number of different templates with various images and design features are 
provided to offer the user a range of choices. To help the user to locate specific types of 
templates of interest to the user, template offerings are sometimes divided into predefined 
search categories (e.g., Type of Industry) and, within a category, into predefined specific 
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subcategories (e.g., Construction, Education, Insurance, Real Estate). After selecting a 
category and subcategory, the user is presented with thumbnail images of available templates. 
If the user selects one, the selected template is downloaded to the user's computer system 
along with downloaded software tools that can be employed by the user to create a 
personalized electronic document. 

[0008] Each template is typically individually designed. The template development 
process includes the definition of all details of the template, such as defining the position of 
all image and text areas in the template, selecting, sizing and positioning images in the 
template, defining colors to be used for template elements having a color attribute, and so 
forth. The template designer will adjust the elements until the designer is satisfied with the 
overall appearance of the template. This hand crafting of template design is time consuming 
and, therefore, a significant expense for the service provider. To continue to expand its 
template offerings and to present potential customers with as many pleasing and varied 
options as possible, the service provider must typically employ a staff of professional 
designers. Further, the service provider may have thousands of images that the service 
provider would like to provide for use, and that customers would like to use, but that cannot 
be quickly made available and exploited because of the time involved in individually 
designing templates on a one-by-one basis. 

[0009] There is, therefore, a need for a novel and flexible template generation system that 
allows a service provider to greatly increase the number and variety of templates offered to 
customers without requiring a laborious individual one-template-at-a-time design method 

Summary 

[0010] The present invention is directed to satisfying the need for systems and methods 
that provide automated generation of electronic product designs. 

[0011] In accordance with the invention, a number of images and layouts are retained 
and, in response to user selection inputs, electronic product designs reflecting combinations 
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of images and layouts associated with the user inputs are displayed to the user. Images are 
automatically sized and cropped appropriately to fit the containers. 

[0012] A portion of each stored image is designated as the minimum image portion that 
can be used. For each container in the layout, stored images are retrieved and automatically 
sized and cropped as appropriate to create a version of the image that both fits the container 
and complies with minimum image standards. 

[0013] It is an advantage of the invention that assembling a design from separate images 
and layouts allows a greater number and variety of designs to be economically offered. It is 
another advantage of the invention that standard image and image container sizes facilitate 
modularity and ease of image and layout combination. 

[0014] It is an advantage of the invention that the workload required to prepare images 
for use in product templates is significantly reduced. 

[0015] It is another advantage of the invention that the sizes of the stored images are 
independent of the container sizes and new container sizes can be introduced without a 
requirement to review or modify the stored images. 

[0016] These and other objects, features and advantages of the invention will be better 
understood with reference to the accompanying drawings, description and claims. 

Brief Description of the Drawings 

[0017] Fig. 1 is a block diagram of a computer system with which the invention may be 
employed. 

[0018] Figs. 2-5 are schematic representations of displays available for viewing by a user 
during the creation of an electronic document. 

[0019] Fig. 6 is a representation of an organization of layout memory 1 12. 
[0020] Figs. 7a-7d depict various layouts. 

[0021] Fig. 8 is a representation of an organization of image memory 113. 



4 



Docket Number: 03-008CIP 

[0022] Fig. 9 is a flowchart of a template generation method. 
[0023] Fig. 10 is a representation of an alternate organization of image memory 113. 
[0024] Fig. 1 1 is a representation of image generation according to the organization of 
image memory 113 of Fig. 10. 

[0025] Fig. 12 is a representation of a generic base image and associated ideal and 
minimum image areas. 

[0026] Fig. 13 is a representation of a generic container. 

[0027] Fig. 14 is a representation of an organization of image memory 113 according to 
the invention. 

[0028] Fig. 15 is a flowchart of a template generation method according to the invention. 

Detailed Description 

[0029] Referring to Fig. 1, an exemplary user computer system UCS 100 includes 
processor 101 and memory 102. Memory 102 represents all UCS 100 components and 
subsystems that provide data storage, such as RAM, ROM, and hard drives. In addition to 
providing permanent storage for all programs installed on UCS 100, memory 102 also 
provides temporary storage required by the operating system and the applications while they 
are executing. In a preferred embodiment, UCS 100 is a typically equipped personal 
computer, but UCS 100 could also be a portable computer, a tablet computer or other device. 
The user views images from UCS 100 on display 140, such as a CRT or LCD screen, and 
provides inputs to UCS 100 via input devices 150, such as a keyboard and a mouse. 

[0030] When UCS 100 is operating, an instance of the USC 100 operating system will be 
running, represented in Fig. 1 by Operating System 103. In addition, the user may be running 
one or more application programs. In Fig. 1, UCS 100 is running Web browser 105, such as 
Internet Explorer from Microsoft Corporation. Other applications that may be running in 
USC 100, such as spreadsheet, e-mail, and presentation programs, are represented as 
applications 104. In the exemplary embodiment, design tool 106 is a product design program 
downloaded to UCS 100 via network 120 from remote server 110. Design tool 106 runs in 
browser 105 and allows the user to prepare a customized product design in electronic form. 
Alternatively, design tool 106 could have been obtained by the user from memory 102 or 
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from another local source. When the customer is satisfied with the design of the product, the 
design can be uploaded to server 1 10 for storage and subsequent production of the desired 
quantity of the physical product on appropriate printing and post-print processing systems. 
As will be discussed in more detail below, the user creates a custom product design by adding 
the user's content to a template prepared by the service provider. Each template is 
conceptually a combination of one or more images and a layout to which is applied a color 
scheme. 

[0031] While server 1 10 is shown in Fig. 1 as a single block, it will be understood that 
server 1 10 could be multiple servers configured to communicate and operate cooperatively. 
Memory 111 represents all components and subsystems that provide server data storage, such 
as RAM, ROM, and disk drives or arrays. Layout memory 1 12 represents the portion of 
memory 1 1 1 that contains the XML layout descriptions. Each layout specifies the size, 
position and other attributes of all product elements such as text containers, image containers, 
graphics, z-index values and so forth. For each different type of product, layouts are 
provided that combine different numbers of image containers in different sizes and 
arrangements. In the postcard example described below, a portion of the postcard layouts 
include a single image container while other portions include two, three and four image 
containers 

[0032] Image memory 1 13 represents the portion of memory 1 1 1 that contains the images 
and related image attributes, such as the image size, the default color scheme associated with 
the image, and the one or more keywords that have been associated with that image by the 
printing service provider. Color scheme memory 1 14 contains the set of color schemes 
developed by the service provider for use in generating templates. A color scheme is a set of 
complementary colors, usually from three to five, pre-selected by the service provider to be 
applied as a group in a template design. Instead of assigning a fixed color to each template 
element having a color attribute, each such element in the template will be associated with 
one of the component positions in whichever color scheme has been selected for use with the 
template. Image sizing/cropping 115 represents the software tools that receive image 
container size information from layout memory 1 12 and image information from image 
memory 1 13 and, if possible within established constraints, perform the image resizing and 
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cropping operations to generate one or more image versions of the appropriate sizes for 
incorporation into one or more identified layouts. 

[0033] In Figs. 2-5, screen 200 represents the display being viewed by the user of UCS 
100 on display 140. Fig. 2 is a representation of an introductory page provided by a Web- 
based electronic document design service provider. The page displays and promotes various 
types of products available from the service provider and offers active controls that allow the 
user of UCS 100 to select a desired type of product for a more detailed presentation of design 
options. By way of example, Fig. 2 shows promotional images for business cards 210, 
standard postcards 220, stationery 230, oversized postcards 240, return address labels 250, 
and brochures 260. Images or promotions for additional products, such as presentation 
folders, invitations, announcements, thank you cards, gift tags, and so forth could also be 
presented on the screen along with other information and links. It will be understood that the 
invention is not limited to documents that are intended for eventual printing. The invention is 
also applicable to the design of documents intended for use in electronic form, such as 
electronic business cards, online brochures, and templates for presentation graphics software 
programs. The invention could as well be readily adapted to a wide range of products that a 
user may wish to customize, such as items of clothing, product containers, promotional 
goods, and so forth. 

[0034] For the purpose of an illustrative example, it will be assumed that the user of USC 
100 desires to create a custom standard postcard and, therefore, selects the standard postcard 
option, for example by clicking with the user's mouse cursor on the standard postcard 220 
image. Referring to Fig. 3, in response to the user's selection, a page directed specifically to 
standard sized postcards is retrieved from server 1 10 and displayed to the user. On this 
page, the user is presented with eight thumbnail images 301-308 of sample postcard template 
designs. The service provider can choose to present more or fewer than eight images 
simultaneously, depending on available display space and the size of thumbnail images used. 

[0035] At this early stage in the design process, the printing service provider is not aware 
of the particular purpose that the user has in mind for the user's postcard. To give the user an 
indication of the types of postcard designs that are possible, the service provider presents the 
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user with the eight pre-designed default design examples 301-308 containing various 
combinations of images, graphics, colors and arrangements to give the user a range of visual 
appearances. 

[0036] To allow the service provider to present the user with candidate product templates 
that are relevant to the user's intended purpose, customization area 310 is displayed to the 
user. Area 310 contains Number of Images tool 3 12, initially at a default setting of 1 
image, and Keyword tool 314, initially empty. In the disclosed embodiment, tools 312 and 
3 14 are both implemented as drop down menus. Other types of selection means could be 
readily employed. For example, tool 314 could be implemented as a search field where the 
user types in one or more terms to be compared with the keywords associated with stored 
images. Customization area 310 could also be implemented to contain additional filters for 
allowing the user to narrow the search according to certain image characteristics or content. 
For example, check boxes or another menu could be provided to allow the user to request 
templates with only photographic images or only illustrations. 

[0037] Tool 312 allows the user to specify the number of images that the user desires to 
see in the product template. When in the selected mode (not shown), tool 312 provides a 
menu allowing the user to choose to see templates having one, two, three or four images. The 
number of image number choices offered by tool 312 may vary among the product types 
depending on the variety of layouts prepared by the service provider for each product type. 
For example, layouts for a relatively large product, such as an 8 Vi by 1 1 brochure could be 
designed by the service provider to contain a greater number of images than smaller products 
such as a business card or standard size postcard. As will be discussed further below, the 
user's inputs from tools 312 and 314 are used to present the user with a set of customized 
template designs. 

[0038] Referring to Fig. 4, the user has expanded menu 3 14 to display the available 
keyword selections. The use of keywords as a means of searching is well known. Scroll bar 
316 allows the user to scroll through the various available keywords. Preferably each image 
is associated with a number of different types of keywords that provide various ways to 
locate the type of images that might be of interest to the user. For example, different 
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keywords might relate to the main subject of the image, the action taking place, the setting, 
and the overall concept. 

[0039] Fig. 5 depicts the example situation where the user has left the number of images 
in tool 312 unchanged at 1 and has selected Keyword 1. The eight initial product templates 
301-308 have been replaced with eight new templates 501-508 generated by the system based 
on the combinations of images associated with Keyword 1 and available product templates 
having one image container. In the example illustrated in Fig. 5, more than eight templates 
were generated. This is indicated to the user by the presence of commonly used navigation 
tool 509, indicating that the user is currently seeing the first of three pages of templates. 

[0040] Referring now to Fig. 6, the contents of layout memory 1 12 will be discussed in 
more detail. Each of the various types of products, such as business cards, postcards, 
brochures and so forth, has a different combination of organizational requirements and 
physical dimensions. Layouts are, therefore, conceptually organized in layout memory 1 12 
according to the type of product. For the set of products shown in Fig. 2, layout memory 112 
will have business card layouts 601, oversized postcard layouts 602, stationery layouts 603, 
brochure layouts 604, return address label layouts 605, and standard postcard layouts 606, 
each of which contains a plurality of layouts for the associated type of product. For 
example, standard postcard layouts 606 contains a plurality of individual XML layout 
descriptions 607. Within each individual layout description is information defining the 
number of image containers in that layout, the size and location of each of image container, 
the z-indices of the containers, and the image container that contains the dominant image. 
This set of information in layout 607 is collectively represented in Fig. 6 as image control 
definition (ICD) 608. 

[0041] Templates are constructed from a combination of separate components and 
attributes. Templates are separated into layouts, images available for placement in the 
layouts and template color schemes. This approach allows candidate templates to be 
assembled dynamically using images that are associated with the keyword entered by the user 
and, therefore, are likely to be relevant to the user's interests. 
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[0042] In addition to images, many templates will have various additional elements, such 
as lines, shapes, and graphic elements. Each of these elements will typically have one or 
more associated colors. If fixed colors are assigned to these non- image elements, or if colors 
are assigned randomly, there is a likelihood that some images will have colors that are not 
visually compatible with adjacent colors, creating an unappealing template. Assigning colors 
to template components is, therefore, advantageously handled by way of a separately 
controlled template color scheme. Techniques for defining and using color schemes are well 
known in the art. 

[0043] A color scheme indicator is assigned to each image group. This indicator 
references a color scheme that contains colors selected by the service provider to be pleasing 
if presented adjacent to the images in the image group. One of the image containers in each 
layout will be identified as the container for the dominant image in the layout. The color 
scheme that is associated with the image placed in the dominant image container will control 
the color scheme used for graphics and other template components having color attributes. 

[0044] To facilitate image and layout modularity and combinability, all layouts are 
designed with standard pre-defined image container sizes and all images are made available 
in at least some of the same standard sizes. The number of different standard image 
containers used and the exact size of each container is a discretionary choice of the service 
provider. 

[0045] Figs. 7a-7d depict a few of the many possible standard postcard layouts. Figs. 7a 
and 7b depict two possible layouts for postcards using a single image. In Fig. 7a, a single 
image 701 occupies the entire area of the card. In Fig. 7b, image 702 is positioned across 
the top portion of the card. Area 703 is a non-image area, such as a field of solid color or 
visual effect. Layouts vary both by the size and shape of the image containers and by the 
location of the image containers. For this reason, multiple layouts may use the same size 
image container, with each layout having the image container located in a different position. 

[0046] Figs. 7c and 7d depict two possible layouts using two images. In Fig. 7c, image 
704 occupies the entire area of the card with smaller image 705 placed above image 704. In 
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Fig. 7d, image 706 is positioned on the left side and image 707 is positioned on the right side 
surrounded by non-image field 708. It will be understood that a great many other 
combinations of image sizes and positions could be developed and made available for users 
by the service provider. Similarly, layouts containing many combinations of image sizes and 
locations could be readily designed using three, four, or more images. 

[0047] Referring now to Fig. 8, the contents of image memory 113 will be discussed in 
more detail. Images are conceptually stored in image memory 1 13 as image groups. An 
image group is a set of different versions of a parent, or base, image. The different versions 
are created by the service provider by taking the base image and performing cropping 
operations, or a combination of zooming and cropping, to create a set of image versions 
designed to fit some or all of the standard image container sizes. Unlike layouts, which are 
typically designed especially for each particular type of product, image groups are made 
available for use with most, or all, different product types. This allows a user to present a 
consistent image by creating multiple different types of materials that all contain versions of 
the same base image. An image group will, therefore, typically contain images ranging in 
size from small images, suitable for use in smaller products such as return address labels, to 
larger images, suitable for use in larger products, such as stationery, brochures and 
presentation folders. Because the subject matter content of some base images may not lend 
itself to certain image container shapes, it is likely that all image groups will not have exactly 
the same set of component images sizes. 

[0048] Referring again to Fig. 8, image memory 1 13 contains a large number of image 
groups. A representative image group is indicated in Fig. 8 as image group 800. Image 
group 800 has an image group identifier 801 and an associated color scheme indicator 802. 
Indicator 802 is assigned by the service provider based on the major color or colors in the 
image and identifies one of the color schemes in color scheme memory 114. Each image 
group also references a number of images 803. As mentioned above, each of the individual 
images in images 803 is a variation of a base image. Each image group in memory 113 
further has one or more associated keywords 804 provided by the service provider to assist 
the user. Keywords 804 are members of the overall universe of keywords presented to the 
user by keyword tool 314. 
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[0049] When an image is placed in the dominant image container in the layout, the color 
scheme indicator 802 associated with that image group is used to identify the color scheme to 
be used to create the template. If the layout has only one image container, the image placed 
in that container will, by default, be the dominant image and the color scheme associated with 
that image will be used to control the colors of other template components, such as 703 in 
Fig. 7b or 708 in Fig. 7d. If the layout contains multiple image containers, one of the 
containers will be designated as the dominant container for that layout. Generally, the largest 
or most prominent container in the layout will be designated as dominant, but dominant status 
can be assigned to any image container in the layout. 

[0050] Turning now to Fig. 9, the system operation will now be discussed. After the user 
has selected the basic type of product the user desires to create at step 902, the creation of the 
specific template designs to be presented to the user is initiated by the user's selections in 
customization area 310. At step 904, the user's act of selecting a keyword triggers the next 
steps in the template generation and displaying process. A set of layouts that have the 
appropriate number of image containers and are for the type of product being designed is 
identified at step 906. At step 908, the set of image groups associated with the selected 
keyword is identified. 

[0051] As discussed above, each image container in each layout will have an associated 
standard size and each image group will have base image variations available in multiple 
different standard sizes. At step 910, the size of each image container in the layouts 
identified in step 906 is determined. At step 912, the images from the image groups 
identified at step 908 having sizes corresponding to the container sizes are identified. 
Because all images will not necessarily be available in all image container sizes, a layout may 
contain an image container size for which no image is available. At step 914, if one or more 
of the layouts identified at step 906 contain an image container size for which no image is 
available, that layout is eliminated from the template generation processing. 

[0052] At step 916, the images identified at step 912 are combined with the layouts from 
step 914 to create templates. The number of templates that will result depends on the number 
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of layouts, the number of images, and the requested number of images per layout. As an 
illustrative example, a user requests templates with a single image at step 902 and selects a 
keyword at step 904. The system identifies, for example, five single-image layouts at step 
906 and four image groups associated with the keyword at step 908. At steps 910 and 912, 
the sizes of the image containers in each layout are compared to the available image size in 
each image group. If each image group has images that match the size of the image container 
in each layout, a total of twenty different templates will be created at step 916. If an image 
group does not have an image size corresponding to the size of the image container in a 
layout, a template for that particular combination will not be generated. For some base 
images, the service provider may choose to perform zooming and cropping operations to 
offer more than one version of the image at the same size. Therefore, the combination of N 
image groups and M layouts could yield more than NxM different templates if one or more of 
the image groups contain more than one image of the container size specified by a layout. 

[0053] As the number of images per layout is increased, the possible number of different 
templates also increases. As an example, assume a user requests templates having two 
images and enters a keyword. For the purpose of the example, assume that three layouts are 
identified having two image containers, four image groups associated with the keyword are 
identified, and each identified image group has an image corresponding to each image 
container size in each layout. In other words, each of the three layouts has a first and second 
image container and each of the four image groups has a version of the image corresponding 
to the size of the first and second containers in each layout. In this example, the available 
images for each layout can be combined in sixteen different ways, if all possible variations 
are allowed, or in twelve ways, if template variations combining two images from the same 
image group are not allowed. The service provider would then have at least 36 templates to 
display to the user. As mentioned above, more or fewer templates could be generated 
depending on the number of available images in each image group that match the image 
container sizes. 

[0054] Occasionally, an inadequate number of image groups may be identified. For 
example, a user may have requested templates with four images, but only three image groups 
associated with the keyword are identified. In this event, rather than disappointing the user 
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by not supplying any templates, the service provider may choose to maintain a supply of 
default images or graphics which the service provider can use to substitute for one or more 
"missing" images. In the above example, templates would be generated using the three 
available images plus one of the default images. Alternatively, the service provider can, upon 
detecting that the number of images available is fewer than the number requested, use layouts 
for the number of images available. In other words, if four images were requested and only 
three image groups are available, the templates will be generated based on three image 
layouts rather than four image layouts. 

[0055] At step 918, a portion of the templates generated at step 916 is selected and 
displayed to the user. Only a limited amount of display space is available for displaying the 
thumbnail template images. In the embodiment shown in Fig. 5, up to eight thumbnail 
images can be simultaneously displayed. If more than eight thumbnail template images were 
generated, they will be ordered into groups of eight for presentation to the user. 

[0056] If the template generation process results in a small number of templates, all 
templates will be simultaneously displayed to the user for review. If the template generation 
process resulted in a large number of templates that cannot all reasonably be displayed 
simultaneously, templates are organized into multiple display pages, each display page 
showing a small grid of template thumbnail images, such as 501-508 in Fig. 5. As can be 
appreciated, the generation of the templates will typically result in images from the same 
image group appearing in multiple different layouts and with the same layout appearing with 
multiple different images. To present the thumbnails in a varied fashion that avoids 
displaying clusters of similar appearing templates, template organizational rules are applied 
when the thumbnails are being arranged into pages for display. To the extent possible, a 
display page of thumbnails will not place the same layout in adjacent positions on the display 
page and will not place layouts containing images from the same image group in adjacent 
locations. 

[0057] The user can review the template thumbnails and select one for individual 
customization, for example by clicking on the desired thumbnail image with the user's mouse 
cursor. The system will then display the product template corresponding to the thumbnail 
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image. At this point, the user may enter additional text or other content for incorporation 
into the displayed product design to create a personalized custom product. When the user is 
satisfied with the appearance of the product design, the user can save the design, for example 
by uploading the design to the service provider's server, and place an order for the production 
of a desired quantity of the product in printed form. 

[0058] Referring to Fig. 10, an alternative embodiment of image memory 1 13 is depicted. 
Each image group has a group ID, color scheme and associated keywords, as described above 
in connection with Fig. 8. Instead of the system storing multiple base image variations, only 
base image 1003 and a plurality of image instructions 1004 are stored for each image group. 
Each of the image instructions 1004 contains the information necessary to create a base 
image variation. 

[0059] By way of example, referring to Fig. 1 1, image 1 100 is a representation of the 
base image. The upper left corner is used as the reference origin and is assigned x and y 
coordinates (0,0). A variation 1101 of base image 1 100 having a size corresponding to a 
layout container of size A can be specified by defining the location of the upper left corner of 
the image (X A i, Y A i) and the desired image height H A and width W A . Alternatively, the 
size and location of an image variation can be determined based on the coordinates of a first 
corner, for example the upper left corner (X A i, Y A i), and a second diagonally opposite corner, 
such as the lower right corner (X^, Y^). If desired, a zoom parameter can also be stored for 
each image variation. This allows a portion of the base image to be defined and then 
enlarged in the amount specified by the zoom parameter to correspond to the size of a larger 
image container. This embodiment eliminates the need for storing the many individual 
image variations, but involves some additional processing at the time of template generation. 

[0060] The foregoing discussion describes systems and methods where all image versions 
are determined in advance. In other words, in the techniques described above, image 
versions were either already generated in predetermined sizes and stored in image memory 
1 13, as discussed in connection with Fig. 8, or instructions for generating the image version 
in predetermined sizes were stored in image memory 1 13, as discussed in connection with 
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Fig. 10. Referring now to Figs. 12-15, an alternate embodiment involving the automated 
generation of image versions will be discussed. 

[0061] As mentioned above, preparing document templates has historically been a 
relatively slow and expensive process. Streamlining image processing to allow the service 
provider to make images available for use by customers in a reusable and flexible manner and 
with a minimum of expensive and time-consuming individual handling and processing by the 
service provider's employees is very advantageous to the service provider. 

[0062] The images as originally acquired or created by the service provider are referred 
to herein as base images. The base images may be of various sizes and shapes and could 
contain a photograph, illustration, pattern, texture, or other content. Fig. 12 is a generic 
representation of a base image 1201 that has been prepared in accordance with the invention. 
A representative or employee of the service provider, referred to herein as the graphic 
designer, has reviewed the base image and has identified an "ideal" image area 1202 and a 
"minimum" image area 1203. These areas were selected by the graphic designer based on 
the graphic designer's expertise, aesthetic considerations, and the specific visual content and 
subject matter of the image. Other factors, such as the type and range of products offered by 
the service provider, may also enter into the graphic designers decision. Once these two 
image areas are defined, the image is essentially ready to be used. No further graphic 
designer action is required and all necessary sizing and cropping of the image to fit various 
sizes and shapes of image containers is performed automatically. 

[0063] Ideal area 1202 is the portion of base image 1201 selected by the graphic designer 
as the most desirable section. This is the portion of the base image that the graphic designer 
believes should, to the extent possible, be used in connection with the product templates 
offered by the service provider. Ideal area 1202 could be set by the graphic designer to be 
equal to the entire base image or could be defined as a smaller area within the base image. 
Minimum area 1203 is the smallest portion of the base image that the graphic designer 
believes is a meaningful or coherent image. Minimum area 1203 could be set to be equal in 
size to ideal area 1202 or could be a smaller area within ideal area 1202. The size of ideal 
area 1202 and its location within base image 1201 and the size of minimum area 1203 and its 
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location within ideal area 1202 are highly dependent on the subject matter and content of the 
underlying base image 1201 and will typically vary significantly from one base image to 
another. 

[0064] Base images are stored as a two dimensional arrays of pixels or "dots". For 
reference purposes, the upper left corner of each base image 1201 is assigned the X and Y 
coordinates (0,0) and is used as the point from which the ideal and minimum image areas are 
located. Base image 1201 has a width WB and a height HB, measured in dots. The position 
and size of ideal area 1202 is defined by the width WI, the height HI, and the offset position 
in dots of the upper left corner relative to the upper left corner of base image 1201, indicated 
as coordinates (XI, YI). The position and size of minimum area 1203 are similarly defined by 
width WM, height HM and the upper left corner offset position (XM, YM) in dots relative to 
the upper left corner of base image 1201. 

[0065] Referring to Fig. 14, a representation of an embodiment of image memory 113 
according to the invention is depicted. Each stored base image 1403 has an associated unique 
image ID 1401, an associated color scheme 1402, and one or more associated keywords 
1405. In addition, associated with the base image are the size and location of the ideal and 
minimum areas within the base image. In the embodiment described, ideal area definition I 
1406 contains the width, height and upper left corner position in dots of the ideal area. 
Minimum area definition M 1407 contains the width, height, and upper left corner position in 
dots of the minimum area. 

[0066] Referring to Fig. 13, generic layout container 1301 having a width WC and a 
height HC is depicted. Container 1301 as depicted in Fig. 13 is merely one representative 
example of the many possible container sizes and shapes that might be used in template 
layouts. The layout descriptions in layout memory 112 will specify the width and height of 
the container or containers used in that layout. The height and width of each container is 
expressed in specific units of measurement, such as inches. 

[0067] For images that are intended to be printed on high quality printing systems, such 
as large offset presses, an image resolution of 300 dots per inch (dpi) or greater is desirable to 
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ensure that the printed image appears sharp and clear to the human eye. A resolution of 300 
dpi is not a fixed requirement, however, and resolutions of slightly less than 300 dpi can be 
accepted with little or no perceptible degradation in image quality. For the purpose of this 
discussion, the lowest threshold of acceptable resolution is considered to be 225 dpi. Other 
lower limits of acceptable image resolution could be employed. 

[0068] For the purpose of this discussion, the physical size of an image at a resolution of 
300 dpi is used to characterize the initial size of an image relative to a container. For 
example, an image measuring 750 by 750 dots would be 2.5 inches by 2.5 inches at 300 dpi 
and would be referred to as being smaller than a 3 inch by 3 inch container, which would be 
capable of holding an image of 900 by 900 dots at 300 dpi. To fit the 3-inch by 3-inch 
container, the 750 by 750 image would have to be enlarged to a resolution of 250 dpi. 

[0069] A container can be any size relative to an image and can have any virtually any 
ratio of width to height. Therefore, referring to Figs. 13 and 14, the width WC of a container 
might be larger than WB, smaller than WM, or anywhere in between. Similarly, the height 
HC of a particular container might be larger than HB, smaller than HM, or anywhere in 
between. The range of container height and width possibilities yields possible combinations 
of container dimensions and base, ideal and minimum image areas ranging from one extreme 
where the container is larger than base image 1201 in both dimensions to the other extreme 
where the container is smaller than minimum area 1203 in both dimensions. 

[0070] Depending on the relative size of the image and the container, creating the image 
version will either require enlargement and cropping or reduction and cropping. When 
cropping is required, cropping rules as discussed below will be applied to determine the 
specific material to be cropped. 

[0071] Because the established goal is to fill the container from the ideal area, the 
decision of whether enlargement or reduction is required is based on a comparison of the 
height and width of the container relative to the height and width of the ideal area. Image 
expansion is performed if the container is larger than minimum area 1203 in both dimension 
and is larger than ideal area 1202 in one or more dimensions. Image reduction is performed 
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if the container is smaller than minimum area 1203 in one or more dimensions or is smaller 
than ideal area 1202 in both dimensions. 

[0072] To deal with the range of container possibilities, automatic image sizing is 
conducted according to predefined resizing constraints that cannot be violated by image 
sizing/cropping 115. The constraints applied to the resizing process are container filling, 
minimum resolution, and minimum image area. The container filling constraint requires that 
a container must be completely filled with image information. No "empty space" in the 
container is allowed. The minimum resolution constraint requires that a manipulated image 
cannot be enlarged to a resolution of less than a minimum resolution consistent with quality 
printing, for example 225 dpi. The minimum image area constraint requires that the entire 
minimum area 1203 must be shown in every version of the image. In other words, all of 
minimum area 1203 must appear in the container and cropping of the minimum image area is 
not allowed. 

[0073] In addition to these constraints, rules to try to achieve desirable goals are applied 
to determine how the image will be sized and cropped. In the discussed embodiment, the 
goal of image sizing/cropping 1 15 is to fill the container with content from the ideal area 
1202, if possible. The image will be enlarged or reduced to try to reach this goal. In other 
words, the resizing process will enlarge or reduce the base image to attempt to resize the 
image such that the image for the container will be taken entirely from within ideal area 1202 
in both dimensions. Because resizing cannot violate any of the above-described constraints, 
this goal cannot be attained in all cases. Some resized image version will include material 
from the base image that is outside of the ideal and some images will be completely 
unsuitable for a particular container because no image version can be created within the 
constraints. 

[0074] Looking again at Fig. 12, the relative position of minimum area 1203 within ideal 
area 1202 can be defined by left offset LMO, right offset RMO, top offset TMO and bottom 
offset BMO. Similarly, the relative position of ideal area 1202 within base image 1201 can 
be defined by left offset LBO, right offset RBO, top offset TBO and bottom offset BBO. 
Ideal area 1202 might touch one or more sides of the base image and, within an ideal area of 
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this type, minimum area 1203 might also touch one or more sides of the base image. 
Therefore, one or more of these offsets could have been set by the graphic designer to be zero 
if ideal area 1202. 

[0075] Once the image has been enlarged or reduced as discussed above, the exact 
portion of the image that will be cropped must be determined. Referring to Fig. 12, an 
illustrative example of one cropping technique will be discussed in relation to container 1204, 
indicated by dashed lines. For this example, it will be assumed that base image 1201 has 
been resized such that the width of container 1204 is equal to the width WI of ideal area 
1202. As shown in Fig. 12, container 1204 height HC is greater than minimum area height 
HM, but less than ideal height HI. Image sizing/cropping 115 positions container 1204 
relative to minimum area 1203 to maximize the probability that the cropped image in 
container 1204 will be as attractive and useful to users as possible. 

[0076] Different cropping position techniques could be used. In the example shown in 
Fig. 12, "proportional cropping" is employed. The same technique applies to both vertical 
and horizontal cropping. As used herein, proportional cropping means that, to the extent 
possible, the relative position of minimum area 1203 within ideal area 1202 is maintained as 
much as possible. Minimum area 1203 is offset by TMO from the top of ideal area 1202 and 
offset by BMO from the bottom of ideal area 1202. The image is cropped such that this 
proportional relationship is maintained. In other words, the top offset TCO and bottom 
offset BCO of minimum area 1203 within container 1204 are set such that the ratio of TCO to 
BCO is the same as the ration of TMO to BMO. In this example, the effect is that relatively 
more material will be cropped from the bottom of ideal area 1202 than from the top. 

[0077] Alternatively, a "minimum area centering" technique could be employed. This 
technique would try, to the extent possible, to crop ideal area 1202 such that minimum area 
1203 is placed as close to the center of the cropped area as possible. In other words, TCO 
and BCO would be set to be equal to each other, if possible, until TCO reaches TMO, which 
is its upper limit under the cropping rules. Horizontal cropping would work similarly. 
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[0078] Because of the constraints mentioned above, resizing will not be able in all cases 
to create an image variation that is completely filled with material from ideal area 1202. An 
example of this situation is indicated in Fig. 12 by container 1205. In this example, the 
height of container 1205 is equal to the height HM of minimum area 1203, therefore base 
image 1201 cannot be expanded further because of the minimum image area constraint. 
Container 1205, therefore, contains some material from base image 1201 outside of ideal area 
1202. Again, a cropping rule will be applied to instruct image sizing/cropping 1 15 how to 
determine the exact horizontal position of container 1204 within base image 1201. The 
particular rule applied is discretionary with the service provider. 

[0079] The rule could be proportional cropping using the relative sizes of LBO and RBO, 
attempting to center the ideal area 1202 in container 1205 to the extent possible, attempting to 
center minimum area 1203 in container 1205 to the extent possible, or another rule as desired 
by the service provider. 

[0080] Referring to Fig. 1 5, the process flow of dynamic cropping will be discussed. 
The process depicted in Fig. 15 is similar to the process discussed above in connection with 
Fig. 9 except that image versions are dynamically generated to fit the containers rather than 
being predefined. At step 1502, the user selects the type of product to be designed. At step 
1504, the user keyword and image number inputs are received. Appropriate candidate 
layouts are identified at step 1506 and images associated with the keywords entered by the 
user are identified at step 1508. At step 1510, the sizes of all image containers in the 
identified layouts are identified. 

[0081] At step 1512, the images identified in step 1508 are sized and cropped, as 
discussed above, to the extent possible within the established constraints, to dynamically 
generate an image version that fits the container size. If an image version of the required size 
cannot be generated, that image is unavailable for use. For a layout to be useable, there must 
be at least one appropriately sized image version for each container in the layout. If a layout 
has a container for which no image of the right size is available, the layout is eliminated at 
step 1514. At step 1516, the layouts and generated image versions are combined to create 
product templates and the templates are displayed to the user at step 1518. 
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[0082] While the invention has been described in various exemplary embodiments, the 
described embodiments are to be considered as illustrative rather than restrictive. The scope 
of the invention, therefore, is as indicated in the following claims and all equivalent methods 
and systems. 
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